160 Scaling and Generalization in Neural Networks : a Case Study
نویسندگان
چکیده
Gerald Tesauro IBM Watson Research Center PO Box 704 Yorktown Heights, NY 10598 The issues of scaling and generalization have emerged as key issues in current studies of supervised learning from examples in neural networks. Questions such as how many training patterns and training cycles are needed for a problem of a given size and difficulty, how to represent the inllUh and how to choose useful training exemplars, are of considerable theoretical and practical importance. Several intuitive rules of thumb have been obtained from empirical studies, but as yet there are few rigorous results. In this paper we summarize a study Qf generalization in the simplest possible case-perceptron networks learning linearly separable functions. The task chosen was the majority function (i.e. return a 1 if a majority of the input units are on), a predicate with a number of useful properties. We find that many aspects of.generalization in multilayer networks learning large, difficult tasks are reproduced in this simple domain, in which concrete numerical results and even some analytic understanding can be achieved.
منابع مشابه
Monitoring of Regional Low-Flow Frequency Using Artificial Neural Networks
Ecosystem of arid and semiarid regions of the world, much of the country lies in the sensitive and fragile environment Canvases are that factors in the extinction and destruction are easily destroyed in this paper, artificial neural networks (ANNs) are introduced to obtain improved regional low-flow estimates at ungauged sites. A multilayer perceptron (MLP) network is used to identify the funct...
متن کاملPrediction of monthly rainfall using artificial neural network mixture approach, Case Study: Torbat-e Heydariyeh
Rainfall is one of the most important elements of water cycle used in evaluating climate conditions of each region. Long-term forecast of rainfall for arid and semi-arid regions is very important for managing and planning of water resources. To forecast appropriately, accurate data regarding humidity, temperature, pressure, wind speed etc. is required.This article is analytical and its database...
متن کاملThe relationship between Neural Networks and DEA-R (Case Study: Companies Stock Exchange)
Evaluate the performance of companies on the Stock Exchange using non-parametric methods is very important. DEA and DEA-R with the strategies for piecewise linear frontier production function and use of available data, assess the stock company. In this study, using a neural network algorithm DEA and DEA-R is suggested to classify the first companies in the stock exchange; Secondly, using the...
متن کاملGeoid Determination Based on Log Sigmoid Function of Artificial Neural Networks: (A case Study: Iran)
A Back Propagation Artificial Neural Network (BPANN) is a well-known learning algorithmpredicated on a gradient descent method that minimizes the square error involving the networkoutput and the goal of output values. In this study, 261 GPS/Leveling and 8869 gravity intensityvalues of Iran were selected, then the geoid with three methods “ellipsoidal stokes integral”,“BPANN”, and “collocation” ...
متن کاملEstimation of Daily Evaporation Using of Artificial Neural Networks (Case Study; Borujerd Meteorological Station)
Evaporation is one of the most important components of hydrologic cycle.Accurate estimation of this parameter is used for studies such as water balance,irrigation system design, and water resource management. In order to estimate theevaporation, direct measurement methods or physical and empirical models can beused. Using direct methods require installing meteorological stations andinstruments ...
متن کامل